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Abstract 

To study topological aspects of the partition function of the NS5-brane in type IIA string 
theory, we define a cohomology class whose vanishing is a necessary condition for this function 
to be well-defined. This leads to various topological conditions, including a twisted Fivebrane 
structure as well as secondary cohomology operations arising from a K-theoretic description. 
We explain how these operations also generate the topological part of the action as well as the 
phase of the partition function. Part of the discussion also applies to the M5-brane. 
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1 Introduction 

The NS5-brane in type IIA string theory is a magnetic brane [8] which enjoys many interesting 
physical and mathematical properties (see e.g. p^). This brane is charged under the dual = Hj 
of the B-field H3 and hence admits as a source the right hand side of the equation of motion of the 
B-field. The field Hj, unlike H3, is hence not closed. This brane is obtained from the dimensional 
reduction of the M5-brane from eleven to ten dimensions, and hence shares many of the properties of 
the M5-brane. For example, the worldvolume theory carries a 2-form potential as part of the chiral 
(0, 2) supermultiplet. Associated with the M5-brane are several new geometric and topological 
structures that the author has been investigating [32] [33] [34] |36j . This note is in some sense a 
continuation of that work but for the closely related setting of the NS5-brane. 

The action. An action for the NS5-brane is given in [3j. Another one, which is free of gravita- 
tional anomalies, for the coupled system of IIA D = W dynamical supergravity interacting with an 
NS5brane is constructed in [9]. We will be mostly interested in the topological terms in the action, 
as described in [46] [48] . 

The partition function. The partition function of the NS5-brane is used in [46] [48] essentially 
as a tool to study the partition function of the M5-brane. This is studied further in |12j |13j in 
the special case when the worldvolume is a Calabi-Yau threefold. Instanton effects from Euclidean 
NS5-branes in type IIA string theory lead to quantum corrections to the hypermultiplet moduli 
space in Calabi-Yau compactifications of type IIA string theories and are governed by the wave 
function of the topological B-model [I] [2]. We will instead concentrate on the topological aspects 
of the partition function on general manifolds with some structure. 

D-branes ending on NS5-branes. D-branes can end on NS5-branes [47] [29]. The tension 
of the NS5-brane is {2tt)~'^ a''^ g^^ while that of a Dp-brane is (27r)~Pa'("P"^)/2^-i^ go ^.j^^^ ^35. 
branes are heavier than D-branes in the perturbative regime and the NS5-brane is a solitonic object 
at weak coupling (i.e. when a' is small). To study the dynamics of D-branes in the vicinity of NS5- 
branes in the weak string coupling regime, the NS5-brane is usually taken to be static [15] |24j . 
In particular, a D2-brane ending on an NS5-brane in type IIA string theory can be obtained from 
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dimensional reduction of a system consisting of an M2-brane ending on an M5-brane in M-theory. 
In fact, the NS5-brane behaves in many respects hke the M5-brane, and so insights from one can 
be used to shed hght on the other. We wih analyze the first system in a way that is similar to the 
analysis of the latter in [llj . In particular, we will provide conditions for the NS5-brane partition 
function to be well-defined. The M-branes admit a description in terms of integral cohomology 
(however, more recent developments suggest generalized cohomology, see [31] |32j). For the NS5- 
brane, we have Ramond-Ramond fields on the right hand side of the equation of motion of the 
B-field. Thus we include in our analysis some effects arising from the K-theoretic description of 
these fields [H] [27]. 



Relating classes on the brane to classes on space-time. We will consider the action of the 
Steenrod square cohomology operations Sq^ : H^{X]'L) on cohomology classes on 

the target ten-manifold X^^ of type IIA string theory. We will also consider the NS5-brane with 
worldvolume M^, a 6-dimensional oriented manifold, as well as its extension to a 7-manifold Y'^ 
and then to an 8-manifold . All three instances of the (extended) worldvolume admit maps to 
spacetime since they represent a brane living in the target space-time. Since the Steenrod square 
is natural, the following diagram is commutative 

H^W-.Z) ^H*{X^^-Z) , (1.1) 



Sq' 



H*{W;Z) ^H*{X^^;Z) 

where W stands for any of the three manifolds M^, Y"^ , or Z^. That is, if we have a class x G 
H*(X^^]Z) then puling back to W and applying the Steenrod square gives the same result as 
applying the Steenrod square and then pulling back the result; this summarized by the relation 
f*Sq^x = Sq^ f*x. Thus, in particular, if we take a; to be a degree four class and z = 3, then classes 
on X^^ that are annihilated by the first differential in the Atiyah-Hirzebruch spectral sequence (as 
in [11]) pull back to classes on W with the same property. 

We will apply the setting of Chern-Simons construction to the NS5-brane. That is, we consider 
the lift of the NS5-brane worldvolume via the circle to get the 7-dimensional circle bundle y '', 
which we take to be a boundary of an 8-manifold Z^ . As explained in [l6] (mostly for the similar 
case of the M5-brane), the extension to Z^ can be used to define the theory in six dimensions. Most 
applications of the fivebrane requires the six-manifold to be a Calabi-Yau space (see e.g. |12j). The 
spaces and Z^ should generally have compatible structures. 

In section [2] we define a new class 11, which captures when the partition function is well-defined. 
The class 11 is integral for SU(n) Chan-Paton bundles of even rank and even second Chern class, 
and its vanishing in cohomology is a necessary condition for the partition function of the NS5-brane 
to be nonzero. This is equivalent to saying that space-time admits a twisted Fivebrane structure 
in the sense of 1381. 



In section [3] we start considering the effect of the K-theoretic description of Ramond-Ramond 
fields. First, we show in section [3?T] that this requires the cohomology class corresponding to -F4 A-F4 
to be the mod 4 reduction of an integral class. This uses secondary cohomology operations. Then, 



2 



in section [3^2] we show that on an almost complex 8-dimensional manifold the cohomology classes 
of the fields F2 and satisfy certain constraints arising from the Euler characteristic and the 
one-loop term. 

Some consequences of the description of the fields and the corresponding constraints are consid- 
ered in section m The first effect, described in section l4m is that the i^4-term in 11 when annihilated 
by the first differential in K-theory gives rise to a quadratic refinement of a bilinear form. The 
topological part of the action of the NS5-brane involving degree four classes is given by a secondary 
cohomology operation Q. on classes z G H^{Z^;'L) which are annihilated by the first differential 
in the Atiyah-Hirzebruch spectral sequence for K-theory. Finally, in section 14.21 we show that the 
phase of the partition function is captured by the signature via |(t(Z^), and is the Zs-valued phase 
of the Pontrjagin square operation on the degree four class. We do this in the setting of Gauss 
sums and cohomology operations. 

Due to the similarities between the type IIA NS5-brane and the M-theory M5-brane, a good 
part of our discussion will apply to the latter as well. 



2 The new class and its effect on the partition function 

Defining the new class. The equation of motion for the B-field is given by (see [5] [IT] |26j ) 



d{e-^* * H3) = iJ^Fo A Fg + £2^2 AFe- -i^Fi A F4 + £% 



(2.1) 



where £s is the string length (a measure of coupling) and Is is the one- loop term |14] |44) . Since 
this expression involves distance (and hence energy) scales, we consider various limits as follows 

1. £s is large: d* H3 '-^ A -F4 + Ig- 

2. is is small: d * ~ Fq A Fg; and ff Fq = then d * ifs ~ F2 A Fg. 

We assume a constant dilaton (p. 

The right hand side of the equation of motion (j2.1|) is the source for the NS5-brane. We define 
the new class corresponding to the right hand side by passing to de Rham cohomology 
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-2Fo a Fg + ilF2 A Fe - F4 A F4 + i% 



(2.2) 



dR 



We now explore properties of this class and their effect on corresponding properties of the NS5-brane 
partition function. 



Integrality of the class. We consider whether the class 11 admits an integral lift, i.e. from de 
Rham cohomology to integral cohomology. Let us consider each one of the three terms separately. 
First, the one-loop term Ig is always integral for Spin manifolds |35]. Then for the other two terms 
we use the K-theoretic quantization of the RR fields [27j 

F(F) = ^/liX) ch(F) , (2.3) 



3 



corresponding to a Chan-Paton bundle E. Considering E to be an SU(n) bundle, we have that 
ci{E) = 0. This then implies that the cohomology class corresponding to the term F2 A Fq will be 
zero, since F2 = ci{E). Thus we still have the first term; consider the degree four RR class 



Fa{E) 



A{X) ch{E) 



-T^nk{E)P^ + C2{E) . (2.4) 



We now make use of the Atiyah-Singer index theorem, which gives that the index of the Dirac 
operator for Spin manifolds is an even integer in dimension four. As a consequence, ■^pi{X) 
is an integer. This, together with the fact that Chern classes are integral classes, implies that 
F4 G H'^{X;'Z). This results in the class corresponding to the wedge product F4 A F4 being 
integral. However, this does not yet imply that the class of A F4 is integral, as we are dividing 
by 2. This division is of no effect if we require the bundles E and E' corresponding to the first F4 
and second F4, respectively, to have even rank and even second Chern class. Therefore, 

Proposition 1 The class 11 is integral for SU(n) Chan-Paton bundles of even rank and even second 
Chern class. 



Explicit expression for IT. The one-loop term is given by [T3] [S] Ig = ^b2(-'^) ~ 

where X{X) = ^pi{X) is the first Spin characteristic class. Together with above expressions for the 

quadratic RR fields, this leads to the explicit expression for 11 
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r2 



P2{X)+{—-l] X{Xy - 4rX{X)c2{E) + 48c2{Ey 



(2.5) 



where r = rank(£^). This can be thought of as the analog of the one- loop term /g, or more precisely 
an analog of the Green-Schwarz anomaly-cancellation term in heterotic and type I string theory 
|19j . The latter also contains terms that arise from Chern classes of a gauge bundle, there being 
an Eg X Eg bundle, as opposed to an SU(n) bundle. Note that in relating to eleven-dimensional 
M-theory, we can choose to retain an Eg bundle- as in |30j- and not perform the breaking down 
to unitary groups as done in [11]. 



Existence of a nonzero partition function. In [10] a necessary condition for the existence of 
a nonzero partition function for the M5-brane in M-theory was derived. This decoupling from the 
bulk is essentially the condition that the class @xiC) lifting the right hand side of the equation of 
motion of the C-field be zero. We will perform an analogous analysis for the NS5-brane, which is 
the result of the vertical dimensional reduction of the M5-brane down to type IIA string theory. 
Instead of satisfying a quadratic refinement as the class Q did, the new class will enjoy index- 
theoretic properties arising from the K-theoretic quantization of the Ramond-Ramond fields [27] 
|18j . For the case of the NS5-brane, we require that the D-brane not end on it so that it is decoupled. 
Thus, in this sense, the D-branes ending on the NS5-branes are the analogs of the M2-brane ending 
on the M5-brane. We have 

Proposition 2 A necessary condition for the partition function of the NS5-brane to be nonzero is 
that the class H is zero in cohomology. 

Now that we have a condition for a well-defined partition function, we ask when such a condition 
is satisfied. We provide one general such instance. 
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Relation to Fivebrane structures. When X{X) = 0, that is when we have a String structure, 
expression ()2.5p simpHfies to 

U = ^P2{X) + C2iEf . (2.6) 

We see that setting 11 = is equivalent to setting ■^p2{X) + C2{E)'^ to zero. The first term is 
essentially a Fivebrane structure [37] and since the second term is integral, the whole expression 
defines a twisted Fivebrane structure [38] with the twist given by the integral class C2{E)'^. Note 
that having a Fivebrane structure implicitly also implies that we already have a String structure 
(this follows from the way such structures are defined via obstruction theory). Therefore, 

Proposition 3 (i) The vanishing of the class 11 is equivalent to a twisted Fivebrane structure, 
(a) A necessary condition for the non-vanishing of the NS5-brane partition function is that space- 
time admits a twisted Fivebrane structure. 

This is the analog for type IIA of the description in |37| |38| for M-theory and heterotic string 
theory. 

3 Constraints on RR fields 

We have seen that the expression ()2.2p for the new class 11 involves a combination of Ramond- 
Ramond fields F2,Fi, and Fq of total degree eight. We will investigate constraints on such fields 
arising from K-theory and from geometric structures on the underlying space. 

3.1 Conditions on F4 

We would like to consider some further K-theoretic aspects of the fields entering in the new class 
n. We will first concentrate on the term quadratic in F4. We will take our starting point that the 
classes representing the RR fields are annihilated by the first differential in the Atiyah-Hirzebruch 
spectral sequence for K-theory; that is we take the class X4 representing F4 to satisfy Sq^x^ = 0. 

One might ask whether the above condition is all what one should impose. Indeed, this is 
not the end of the story. In addition to the above primary operation, we will have a secondary 
operation, valid once the primary one is satisfied. This secondary operation is given by the Toda 
bracket 5^1, X4). This will in fact take us beyond the Z2 and Z3 coefficients encountered in 

previous literature (see [11] and [16], respectively); we will be dealing with Z4 coefficients. 

Secondary cohomology operations. H If the cohomology class x is such Sq^x = then there 
is a secondary cohomology operation that can arise and that takes the form 

{SqlSqlx)=(3iSq^x. (3.1) 
^The author thanks Mike Hill for useful discussion on the material of this section. 
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This can be seen as follows. Consider the diagram which depicts the various cohomology operations 
and maps that we have 



/ a 



(3.2) 



Here S"i/Z represents the n-suspension of integral cohomology, which is the same as integral 
cohomology with degree shifted up by n. We start with a cohomology class x on M. Applying Sq^^ 
to it gives a class S(^x G S^iJZ. The composition a o 6 is the secondary cohomology operation 
represented by the Toda bracket {Sq^^, Sq^,x). 

We have the Adem relation Sq^Sq^ = Sq^ + Sq'^Sq^, which is equal to Sq^, since we are working 
integrally. The spectral sequence is summarized as follows 






t 




1 






2 






3 


Sq^i 




4 


Sq'^i 


Sqh2 


5 


Sq^i 


Sq^i2=l32Sq^i 



(3.3) 



Corresponding to the sequence of coefficients Z Z Z4, have the following relation between 
the corresponding cohomology groups 

HZ4 — ^j:hz , (3.4) 




so that /Jf is the Bockstein taking cohomology in Z4 coefficients to integral cohomology in one 
higher degree. The Toda bracket then takes the form 



{Sql Sql X4) = /3f S(?^X4 = /32^(X4 U X4) . 



(3.5) 



Therefore, we have 
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Proposition 4 The K-theoretic description of Ramond-Ramond fields requires the cohomology 
class corresponding to F4 A F4 to be the mod 4 reduction of an integral class. 

3.2 Conditions on F2 and Fq. 

We will apply the setting of the Chern-Simons construction to the NS5-brane. That is, we 
consider the lift of the NS5-brane worldvolume via the circle to get the 7-dimensional circle 
bundle Y"^ , which we take to be a boundary of an 8-manifold Z^. As explained in [46] (mostly 
for the similar case of the M5-brane), the extension to can be used to define the theory in six 
dimensions. Most applications of the fivebrane requires the six-manifold to be a Calabi-Yau space 
(see e.g. [12]). The spaces 1"^ and Z^ should generally have compatible structures. Thus we will 
work with 8-manifolds which admit an almost complex structure (and not necessarily Spin) and ask 
for constraints on F2 and Fq due to this. This discussion is in spirit (although not in techniques) 
analogous to the discussion of the one- loop term in [23] [1]. 

We will use the class of F2 to define a complex line bundle over the NS5-brane worldvolume. 

Almost complex structures. An almost complex structure (acs) on a manifold M of dimension 
2n is an endomorphism J of the tangent bundle TM satisfying = —1. This gives TM the 
structure of a complex vector bundle. From obstruction theory, an almost complex structure can 
be viewed as a section of the S0(2n)/U(n) bundle associated to TM [39j. On the other hand, 
a stable almost complex structure (stable acs) on M is a reduction of the structure group of the 
stable tangent bundle of M from SO to U. The necessary conditions for the existence of a stable 
acs are the existence of integral lifts (for suitable i) Ci G H'^^{M;7j) of the even Stiefel- Whitney 
classes W2i € -ff^*(M;Z2), that is W2i{M) = p2Ci, where p2 is mod 2 reduction. This is equivalent 
to saying W2i+i{M) = € i7^*^^(M;Z). Such conditions are natural to impose on branes. In 
the 8-dimensional case, the two conditions are = and W7 = 0. The latter is automatically 
satisfied on our manifolds of dimension less than or equal to eight [25]. 

We will take u G H'^{Z^;Z) and v G i/^(Z*;Z) be the cohomology classes corresponding to 
the fields F2 and Fq, respectively. Consider Z^ to be an 8-manifold with a stable almost complex 
structure io. Let (u, v) to be a pair of class in H'^{Z^; Z) x H^(Z^; Z) such that p2U = W2{Z^) and 
P2V = wq{Z^). From the expression of the Chern character chs = |(3c3 — 3ciC2 + cf) we see that 
if C2{uj) = = pi{Z^) and 3c3(a;) = ci{uj)^, then u = F2 = ci{uj) and v = F3 = 03(0;). In this case, 
the Chern classes satisfy (see [21]) 



This follows from a more general formula, using p2x{Z^) = P2C4:{Z^) = ws{Z^). Indeed, we will 
apply the more general main result of [20]: The manifold Z^ has an almost complex structure if 
and only if [20] 



204(0;) + ci(o;) • cs{uj) 
2x(Z8)+ci(o;)-C3(w) 



(mod 4) , 
(mod 4) . 



1. WsiZ^) G Sq^H%Z^;Zy, 

2. P2U = W2iZ^) and p2V = wq{Z^); 
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3. 2xiZ^)+u-v = ( mod 4); 

4. 8x{Z^) = ^P2{Z^) - Pi{Z^? + 8u-v-u^ + 2u^pi{Z^) 

The manifold Z^ has a stable acs to if the tangent bundle TZ^ is stably isomorphic to the 
underlying real bundle of some complex vector bundle over Z^. This will be an actual acs if 
c4u) = x{Z^)- 

The above discussion immediately gives the following constraint on the cohomology classes u 
and V corresponding to the fields F2 and Fq, respectively. 

Proposition 5 On an almost complex 8-dimensional manifold, the cohomology classes of the fields 
F2 and Fq satisfy 

2u-v -lu^ + u'^ ■ A(Z^) = 2x{Z^) - 3Is{Z^) ■ (3.6) 
8 

In the particular case where the Pontrjagin classes vanish, and hence the one-loop term is zero in 
cohomology, the constraint simplifies to 

u-v-^u^ = x(^') , (3.7) 
i.e. the two classes are constrained by the Euler characteristic. 

4 Consequences for the action and partition function 

In this section we consider some topological consequences of the classes we have been using. We will 
concentrate mostly on effects related to the degree four field -F4 and it corresponding cohomology 
class. 

4.1 The action via cohomology operations 

We will now show that the topological action involving the degree four field is generated by coho- 
mology operations and leads to a quadratic refinement of a bilinear form. We will make us of some 
of the constructions in [7J and [l3] . 

On H^{Z^;7j) we have the relation among Steenrod squares 

{Sq^P2) o {f3Sq^p2) = , (4.1) 

where /3 is the Bockstein. This can be seen as follows. For a degree four class x, we have 
Sq^ P2{fiSq^ P2u) = Sq^Sq^Sq^ P2X, which gives Sq^Sq^p2X by virtue of the Adem relation Sq^ = 
Sq^Sq^. Another version of Adem relation leads to Sq^Sq'^p2X + Sq^Sq^ p2U, with the second fac- 
tor being zero since Sq^p2 = 0. Since Sq^ acts as squaring on classes of degree i, this then gives 
Sq^P2X^ = 0, again due to Sq^p2 being identically zero. 

Let denote the secondary cohomology operation associated with the relation (14. ip . The 
operation is defined on the subgroup 

G{n, Z^) = {x G H^{Z^- Z) I (3Sq^p2X = O} (4.2) 
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and takes values in the factor group H^{Z^; Z2)/Sq'^p2H^{Z^;Z), where the quotient is the indeter- 
minacy. The operation 17 is not uniquely specified by the above relation: il' = O + Sq^ is another 
secondary cohomology operation associated with the same relation. One can remove this ambiguity 
by normalizing, i.e. by taking p2x'^ G Q{x) for x G H'^ {MP^ ; . Let z,z' € -ff^(Z®;Z) be degree 
four classes in the domain of 17 that is annihilated by Sq"^. Then, from [l3], the operation $7 leads 
to a quadratic refinement 

n{z + z') = n{z) + n{z') + {z-z'} , (4.3) 

where {z ■ z'} denotes the image of p2{z ■ z') in (Z^ ; 7^2) / Sq'^ p2H^{Z^;7j). 

The following is analogous to the corresponding statement in M-theory |31j 

Proposition 6 The F^-term in U when annihilated by the first differential in K-theory gives rise 
to a quadratic refinement of a bilinear form. 

The case when Z^ is Spin. When Z^ is taken to be Spin, then for all z G H^{Z^;Z) the action 
of mod 2 reduction on the expression appearing in the topological part of the action leads to 

P2izqi{Z^) - Z^) = Wi{Z^)p2Z - P2Z^ 

c 4 2 

= Sq P2Z - P2Z , 

which gives zero. Since H^(Z^;7j) = Z, there is a unique y E H^{Z^;'L) such that 2y = zqi{Z^) — z'^. 
Then it makes sense to denote y = ^^{zqiiZ^) — z"^). In the Spin case, for every z G G{Q., Z^) we 
have 

^{z) = p2\[zq^{Z^) - z^) , (4.4) 

which is the topological part of the action, in the M5-brane case 06] [22]. Therefore,! 

Proposition 7 The topological part of the action of the NS5-brane involving degree four classes is 
given by the secondary cohomology operation Q on classes z G H^{Z^;Z) which are annihilated by 
the first differential in the Atiyah-Hirzebruch spectral sequence for K-theory. 

4.2 Quadratic refinements and the partition function 

Having identified various structures associated with the topological action, we now turn to the 
partition function on which we consider the corresponding topological effects. Using this, we will 
show that the phase of the partition function, given by one eighth of the signature of the 8-manifold, 
is given by a secondary cohomology operation. The discussion in this section also applies to the 
M5-brane. 

Reduction of the Hirzebruch L-polynomial. The topological action will involve the Hirze- 
bruch L-polynomial of Z^, via ^L2{Z^) as in ^22j. We would like to characterize the division by 8. 
The division by 2 and 4 are easy to describe via reduction mod 2 and mod 4, respectively. Indeed, 
from the formulas in [42j we have 

P2L2 = P2i'Piv4)) = vl eH\BS0;Z2). 

P4L2 = V{v4) + i* {ws + weW2 + wj) e {BSO; Z4) , 

''while this is done for the case when has no boundary, we will consider the more general case in the next 
section. 
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Here V is the Pontrjagin square cohomology operation 



V : H^{Z^]'L2) ^'Li (4.5) 

and i : Z2 ^ Z4 is the inclusion. What we need is reduction modulo 8. We study this using the 
classic constructions in [6]. 

A partition function in our context is essentially an instance of a Gauss sum. 

Gauss sums. Consider a finite group T and a function ip : T ^ M/Z. The associated Gauss sum 
corresponding to ip is given by 

G{iP) = e^^*'^^^') . (4.6) 

This expression splits into a magnitude or norm, N{^p) = \G{^)\, and a phase f3{'ip) S M/Z (which 
can be defined only if the norm is nonzero) via 

G(V^) = N{iP) ■ e2^^^(^) . (4.7) 

Let K he a subgroup of T the restriction of ip to which is zero, i.e. Vl-ftr = 0. Then it can be shown 
(see [40j) that the Gauss sum is determined b y the restriction to the complement 

= \K\ . G(V'l^v^) • (4-8) 
Note that ipx^/K ■ K^/K Q/Z is well-defined since K C K-^. 

The phase when closed. Consider the case when is taken to be closed, in addition 
to being connected and oriented. The cup product pairing iif^(Z^;Z) x H^[Z^;'L) Z2 admits 
a quadratic refinement given by the Pontrjagin square V. By Morita's proof j28j of Brown's 
conjecture, the phase of the Pontrjagin square is given by 

m = ^ e Q/Z , (4.9) 

where (t{Z^) is the signature of the 8-manifold Z^. This can be shown as follows. Let K denote the 
image in H'^{Z^- Z) ® Z2 of of the torsion in H'^{Z^] Z). Then K^/K = (if4(Z8; Z)/torsion) (g) Zg. 
Now since H'^{Z^]'L) (8) Z2 C H^{Z^;'L2) the Pontrjagin square is just the cup product square 
reduced mod 4. This implies that V vanishes on K. Therefore, if B is the bilinear form on 
i?*^(Z®; Z) /torsion then the refinement induced by V on /K is simply B ®\2. 

The phase when Z^ has boundary. We work with relative cohomology of the pair {Z^,Y'^), 
where is the boundary of Z^. In this case, the Pontrjagin square V : i?'^(Z^, y^; Z2) — )• Z4 is 
still the quadratic refinement of the cup product pairing. However, in this case we distinguish two 
cases, depending on whether or not the cohomology of Y"^ has torsion in degree four. 
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1. Torsion-free case. If H'^{Y'^;Z) is torsion-free, then ()4.5p holds. This can be seen as follows 
(see [30j for a general discussion). When there is a boundary, the cup product pairing has an 
annihilator: if T = H'^{Z^, Y'^; Z2), then T-^ is the image of ij3(y7. in H*{Z^, V'^- Z2). Let us 
start with a degree three cohomology class x S H^{Y'^;Z2) and get a Z4 quantity in two different 
ways. On the one hand, from the cohomology exact sequence corresponding to the relative pair 
{Z^, Y'^), we can map x to a class in H'^{Z^, Y^; Z2), on which we can apply the Pontrjagin square 
to get 

if3(y^; Z2) ^ H^{Z^, Z2) ^ H^{Z^, Y'^; Z4) = Z4 . (4.10) 

On the other hand, starting with x, we take its cup product with the degree four class Sq^x to get 
a class in i?^(y^;Z2) 

^3(y7. ""^^^'^ . H^Y-'; Z2) = Z2 C Z4 . (4.11) 

It follows from the general results of [41J that the two compositions, (|4.10p and (|4.11|) . are equal. 
If iJ'^(y Z) is torsion-free then Sq^x = 0, so that V vanishes on T"*-. We can identify T/T^ with 
the image of i^^(Z^ Y'^- Z2) in H'^{Z^; Z2). 

The cup product pairing on i7^(Z^, y^; Z2) comes from a bilinear pairing 

A : i^^(Z^ y^; Z2) ® H^{Z^, y^; Z2) ^ Z2 (4.12) 

whose adjoint is an isomorphism. If ^ C H^{Z^; Z2) denotes the image of the torsion subgroup of 
H'^{Z^;Z) in H^{Z^;Z2), the A-^ C H^{Z^,Y'^;Z2) is the image of H^{Z^,Y'^;Z). 

The enhancement V is related to the mod 2 reduction of the integral form. If there is no 
2-torsion in ff^(y^;Z) then the image of H'^{Z^,Y'^;'E) in i?^(Z®; Z) /torsion has a nonsingular 
bilinear pairing with a matrix Bz of determinant det-B^ = ±1. This gives that V and i/jbz 
equivalent. 

2. Torsion case. We now consider the case when //^(y^;Z) has torsion, with torsion subgroup 
T^(y^). The various cosmology groups are related via the maps i : T'^{Z^) — )• T^(y^) and j* : 
H^{Z^,Y'^;Z) H'^{Z^;Z). Take tp : r'^(y^) Q/Z to be a quadratic function over the linking 
pairing L : T'^{Y'^) x T^{Y'^) Q/Z. Let V4 G 77^(^8, y^; Z2) and 174 G H'^{Z^-Z) be liftings 
of the Wu class ^4 € H^{Z^;Z,2) to relative mod 2 cohomology and integral absolute cohomology, 
respectively, compatible with tp. Compatibility with ip means that for all x £ T^{Y'^) such that 
X = i*{y) where y G i7^(Z'*;Z), we have 

V^(x) = \{y ■ i)4, [Z\Y']) - ^(y • {f y^, [Z\Y^]) G Q/Z . (4.13) 

Such a lifting always exist [6]. As a consequence, we have j*{v/C} = P2Wj^)] there is a class h G T^iY'^) 
such that ipi{x) = L{b,i{x)) for x G T'^{Z^), and a class t G T^(Z^) such that i*(t) = 2b. 

For 6 G H^{Y'^;Z) and 2 G i?^(Z8, y'^; Z2) have {V{z), [Z^y'^]) = L(6,6) G Z4. Now the index 
is given by I{Z^) = {vj, [^^y^]) + L{b,b) - \G{T^{Y'^),i^)\ G Z4. Therefore, the signature mod 8 
is given by the formula 

a{Z^) = {{vl [Z\Y^]) + m) - \G{T\Y^),ij)\ G Zg . (4.14) 

We summarize our discussion above with the following 
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Proposition 8 The phase of the partition function, given by |o"(Z^), can be described as the phase 
of the Pontrjagin square operation on the degree four class. In the case when H^{Y'^;7j) has torsion, 
the formula is given by (j4.14p . 

The first part of the statement can be viewed as another way of viewing the phase vs. [l6] |22j . 
in the case when the Wu class can be set to zero (see [361 for a discussion of when this can occur). 
Other effects of the Pontjagin square in the case of the M5-brane is considered in [34J. The general 
index problem in the presence of a boundary can be described in a way analogous to the discussion 
in [35] for the case of M-theory. 
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